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@ Pattern-Recognition System for Approaching a Known Target 

Multiple image features are utilized in a multiphase data-fusion process. 
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Features of the Ramps are used in close-range navigation. 


A closed-loop pattern-recognition sys- 
tem is designed to provide guidance for 
maneuvering a small exploratory robotic 
vehicle (rover) on Mars to return to a 
landed spacecraft to deliver soil and 
rock samples that the spacecraft would 
subsequendy bring back to Earth. The 
system could be adapted to terrestrial 
use in guiding mobile robots to ap- 
proach known structures that humans 
could not approach safely, for such pur- 
poses as reconnaissance in military or 
law-enforcement applications, terrestrial 
scientific exploration, and removal of 
explosive or other hazardous items. 

The system has been demonstrated in 
experiments in which the Field Integrated 
Design and Operations (FIDO) rover (a 
prototype Mars rover equipped with a 
video camera for guidance) is made to re- 
turn to a mockup of Mars-lander space- 
craft. The FIDO rover camera au- 
tonomously acquires an image of the 
lander from a distance of 125 nr in an out- 
door environment. Then under guidance 
by an algorithm that performs fusion of 
multiple line and texture features in digi- 
tized images acquired by the camera, the 
rover traverses tire intervening terrain, 
using features derived from images of the 
lander truss structure. Then by use of pre- 
cise pattern matching for determining the 
position and orientation of the rover rela- 
tive to the lander, the rover aligns itself with 
the bottom of ramps extending from the 
lander, in preparation for climbing the 
ramps to deliver samples to the lander. 

The most innovative aspect of the sys- 
tem is a set of pattern-recognition algo- 
rithms that govern a three-phase visual- 
guidance sequence for approaching the 
lander. During the first phase, a multifea- 
ture fusion algorithm integrates the out- 
puts of a horizontal-line-detection algo- 
rithm and a wavelet-transform-based 
visual-area-of-interest algorithm for de- 
tecting the lander from a significant dis- 
tance. The horizontal-line-detection al- 
gorithm is used to determine candidate 
lander locations based on detection of a 
horizontal deck that is part of the lander. 
The wavelet transform is then performed 
on an acquired image, and a texture sig- 


nature is extracted in a local window of 
the wavelet coefficient space for each of 
the candidate lander locations. The mul- 
tifeature fusion algorithm eliminates 
false positives arising from terrain fea- 
tures. The multifeature fusion algorithm 
is coupled with a three-dimensional vi- 
sual-terminal-guidance algorithm that 
can extract and utilize cooperative fea- 
tures of the lander to accurately, itera- 
tively estimate the pose of the rover rela- 
tive to the lander and then steer the 
rover to the bottom of the ramps. 

The second phase begins when the 
rover has arrived at =25 m from the lan- 
der and ends at a distance of =5 m. Inas- 
much as the distance is more important 
than the position of the rover during 
this phase, the system utilizes parallel 
line features extracted from a truss struc- 
ture that is part of the lander. In order to 
correctly distinguish the truss structure, 
the deck, which appears as a set of nearly 
level lines, is detected first. Any parallel 
lines below the deck are considered to 
be parts of the truss structure. Average 
distances between parallel lines are then 
used to estimate the distance from the 
rover to the lander, and the centroid of 
the parallel lines is used to compute the 
heading from the rover to the lander. 

During the third phase, distinctive pat- 
tern of six stripes on the ramps is utilized 
in a close-range algorithm for positioning 
the rover within 10 cm of the bottom of 
the ramps. At the beginning of this phase, 
when the rover is ~5 m from the lander, 


the rover circles around the lander. The 
close-range algorithm includes three 
major steps: feature extraction, feature 
match, and pose estimation. The features 
are the six stripes, which are arranged so 
that any two of them is a topologically and 
spatially unique combination, so as to 
greatly reduce uncertainty and computa- 
tional complexity. 

An edge-detection subalgorithm is ap- 
plied first. Then all straight-line seg- 
ments are extracted. In order to find the 
stripes, the close-range algorithm looks 
for the ramps, which are defined by a set 
of long straight and nearly parallel lines 
(see figure). When a single stripe is de- 
tected in the image, a linear affine trans- 
formation based on its four corners can 
be constructed. If transformation pro- 
vides a correct match with a known 
stripe, it can help to find other matches. 
A search on all stripes is performed to 
find the best matches. Once the matches 
are found, the position and orientation 
of the rover relative to the lander are es- 
timated by use of the outside corners of 
the stripes. A minimum of four stripes is 
used to ensure safe navigation. 

This work was done by Terrance Hunts- 
berger and Ya ng Cheng of Caltech for NASA’s 
Jet Propulsion Laboratory. Further informa- 
tion is contained in a TSP (see page 1 ). 

The software used in this innovation is 
available for commercial licensing. Please 
contact Karina Edmonds of the California 
Institute of Technology at (626) 395-2322. 
Refer to NPO-41867. 
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